Emergence of multiple time scales in coupled oscillators with plastic frequencies 
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A coupled-phase oscillator model where each oscillator has an angular velocity that varies due to 
the interaction with other oscillators is studied. This model is proposed to deepen the understanding 
of the relationship between the coexistence and the plasticity of time scales in complex systems. 
It is found that initial conditions close to a one cluster state self-organize into multiple clusters 
with different angular velocities. Namely, hierarchization of the time scales emerges through the 
multi-clustering process in phases. Analyses for the clusters solution, the stability of the solution 
and the mechanism determining the time scales are reported. 
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Recently, dynamical phenomena with wide ranges of 
time scales are attracting much attention as these play 
important roles in many observed complex systems in 
Physics, Chemistry, and especially Biology[lj, |2j. For 
example, reflection, adaptation and memorization of re- 
action behaviors in biological organisms are identified 
with different characteristic time scales whose correla- 
tion gives rise to unified responses of individuals. Since 
the time scale diversity is observed not only in higher or- 
ganisms with advanced neural systems but also in single 
cell organisms such as bacteria 0] and paramecia Q , it is 
thought to be an essential property for all living organ- 
isms. There is few frameworks to discuss the correlation 
over wide variety of time scales. The development of the- 
oretical approaches for multiple time scale systems very 
much remains a topic of current interest [f|. 

Another remarkable phenomenon related to multiple 
time scales in biological systems is the plasticity of time 
scales. For example, some types of neurons have vari- 
able spiking frequencies that arc thought to be important 
for characterizing the dynamics of neural systems 0, Q . 
Additionally, oscillations of metabolic reactions have also 
been reported to display widely changing frequencies Q • 
It can be expected, therefore, that the plasticity of the 
time scales has a direct impact on the diversity in these 
systems. 

Since the time scales in biological systems are often 
strongly correlated with concentrations that can be mod- 
eled as simple variables, it is appropriate that the plastic- 
ity of time scales is described as the change of dynamical 
variables in models. For example, an enzyme concen- 
tration regulates the reaction rate in a Michaelis-Mcntcn 
type reaction. Additionally, the bursting rates of some 
neuron cells are controlled by calcium concentrations in 
the cells @. Therefore, large networks of enzyme reac- 
tions or assemblies of neurons can be studied based on 
the plasticity of the time scales. For a practical example, 
a model treating frequencies as variables dependent on 
a metabolite accurately reproduces certain behaviors of 
the true slime mold la ■ 



In this paper, we present a mechanism that can gen- 
erate a wide variety of time scales based on time scale 
plasticity. The multiplicity of the time scales is not pro- 
vided a priori, and it is assumed that the plasticity of 
the characteristic time scales depends on the state of the 
system. In the context of dynamical systems modeling, 
this means that variables need to be introduced which 
represent the characteristic time scales, and that the hi- 
erarchy of the time scales is supposed to be generated 
through a self-organizing process [9j . 

We focus on models of coupled oscillators which have 
the fruitful behavior in dynamics such as entrainment, 
phase locking, clustering and so on and introduce 
plastic frequencies (i.e. time scales) on them. The real- 
ization with phase oscillators, as one of the simplest case, 
is given by 



1 N 

— (1 - cos(0; - 6 3 )) - a Wl 



(1) 



where the angular velocity wt of oscillator i denotes the 
inverse of the time scale and is a variable that is varied 
based on the phase differences (8i — 6j) in an all-to-all 
coupling scheme. Increasing the phase differences lead to 
an acceleration of the oscillators, while global synchro- 
nization stops them. The parameter a is set to 0.1 in 
order to assure that the variance ratio of w is smaller 
than that of 8. 

This model shows multiple clusters states in which 
clusters with different number of oscillators have different 
frequencies. Namely, the hierarchical structures in the 
frequency space emerge through the clustering process of 
oscillators in phases. When such a hierarchy of clusters 
exists, the dynamics of even widely separated time scales 
are essentially correlated for the reason that the stability 
of each cluster is maintained by its interaction with other 
clusters. 

Here, we present our numerical results for equation 
Q. In Fig. ^ it is shown that when taking a set of 
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FIG. 1: Top: Time series of wi (dotted line), wis (dashed 
line) and ii> ot hers (slid line). Middle & Bottom: Time series 
of sin(0i) and sin(0 2 ). N = 20, a = 0.1. Oscillator 1 and 18 
separate to form a smaller cluster, thus a 2:18 clustering state 
emerges. The convergence ratio of Wi between the clusters 
agrees with the inverse of the ratio of oscillators numbers • 

Wi and 9i near the one-cluster state as initial conditions, 
the emergence of a hierarchy in the time scales can be 
observed in a form of symmetry breaking. Typically the 
system evolves over time as follows. First, the frequen- 
cies (angular velocities Wi) of all oscillators approach zero 
coherently while the phases are synchronized. Second, a 
few oscillators separate from the cluster and start to os- 
cillate rapidly (oscillator 1 and 18 in Fig. Then, the 
oscillators in the remaining cluster attain a uniform fre- 
quency and phase-synchronization, i.e. a stable cluster is 
formed. The fraction of the size of the largest cluster is 
shown in Fig. [2J 

The oscillators separated from the one cluster state, in 
some cases, form smaller clusters to be multiple clusters 
states, or oscillate independently in other cases. While 
the one cluster state is unstable and splits spontaneously, 
the clusters in the split states are robust against small 
perturbations by noise, and thus the multiple clusters 
states are attractors. 

Here we note on a two clusters state which contains 
n and m oscillators (n > m, n + m = N) as a specific 
case. It is numerically observed to fulfill a relation for 
the averaged frequencies of these clusters (w n ,w m ) and 
the number oscillators 

^ = ™. (2) 

w m n 

As a result, this very simple model generates the robust 
structures of hierarchical frequencies which fulfill the sim- 
ple relation. 




FIG. 2: The size of the largest cluster is plotted as a function 
of the variance of the initial conditions. The variance of 9 is 
fixed to 10 -2 and the variance of w is bounded by 10 -4 < 
a w < 10 - . 1000 samples are tested for each value. The 
numbers in the figure represent the cluster-sizes obtained and, 
as can be seen, initial conditions closer to the one-cluster state 
yield larger uniform clusters, broadening the spread of the 
time scales. 

The properties of the model can be summarized as fol- 
lows; (i) a single coherent state is unstable and splits into 
some groups, (ii) clusters in split states are stable, (iii) 
the fraction of frequencies fulfills the condition (J2J which 
generates the hierarchy of time scales from multi-clusters 
structures. 

Since the interacting term only affects the variance of 
Wi, items (i) and (ii) concerning the coherence in 9i reveal 
nontrivial properties. These arc discussed in detail below. 
First, however, let us consider item (iii) which has a clear 
mechanism. 

The frequencies of the clusters in a steady state are 
regulated by the states themselves. Since the couplings 
among synchronized oscillators have no effect, the Wi of 
an oscillator that joins a cluster is activated by oscilla- 
tors that don't join the cluster. As a is set to 0.1 and the 
variation of Wi is slower than that of 0i, the effect of the 
coupling 1 — cos(#i — 0j) is averaged over time, and the 
averaged frequencies are proportional to the number of 
oscillators that do not join the clusters. Therefore, when 
two clusters with n and m oscillators coexist, the ratio 
of the averaged frequencies (w n /w m ) fulfills the condi- 
tion J2J. Applying this discussion to multi-clusters states, 
where there are I clusters with m, • • • ,7ij oscillators re- 
spectively (J2 n i = N), the relation between averaged 
frequencies is 

in, _ N -Uj 

w nj N — Uj 

Thus, multi-clusters states leads to multi-frequencies. 

In order to analyze how the one cluster state becomes 
unstable and how the multi-clusters states emerge, cor- 
responding to (i) and (ii), we now introduce a reduced 
description of the system. 

To investigate the stability of the one cluster state, we 
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FIG. 3: Phase space of the two clusters description in relative 
coordinates. Open circles denote the one cluster state, and 
the dotted line (£ = 2tt) coincides with the line £ = to form 
the cylindrical phase space. Null clines (dashed lines) and 
typical orbits separating from the one cluster state (thin solid 
lines) are also plotted . The orbit converges around u — A/a. 



take a two-cluster state as the initial condition, 



Wi = Wf, 



k = Of i = 1 , . . . , m 
) j =0„ j = m + l,...,N 

(N = m + n, n > m) 



(4) 



so that the system reduces to four variables. If we then 
introduce the relative coordinate 



uj 



Wi 



(5) 



the description can be further reduced to only two vari- 
ables in cylindrical phase space, 



solution expanded in a into duj/dt; 
paring the both sides, we obtain 

uj = asin(£) +0(a 3 ). 

a 



<i>/£ and by com- 



(9) 



which is in fairly good accordance with the numerical 
simulation. 

In order to discuss the stability of the clusters in 
the two clusters state, we divide a cluster of them vir- 
tually and again describe the displacements with rela- 
tive coordinates. Suppose a cluster containing n oscilla- 
tors is divided into two clusters with n\, n 2 oscillators 
(n = n!+n 2 ). Let e and 8 be the differences of the phases 
and the frequencies between the clusters respectively. Be- 
cause our concern is the linear stability of the cluster, we 
focus on the region with sufficiently small e and i5. The 
previously employed coordinates (f,w) are then naturally 
defined as the differences between the center of the di- 
vided clusters and the other cluster, 



£ = UJ 

uj =A{l-cos(£) cos(f)} 



+ Bsin(f)sin(!) 



2iV 



{1 — cos(<5)} — auj 



(10) 



5 = 6 

( = - 



2m sin(£) sin(|) + B{1 - cos(5)} - ae ^ 



D 



N 

n 2 - ni 
N 



(12) 



The origin of the (<5, e) plane corresponds to the two clus- 
ters state. The region \S\,\e\ <C 1 is considered, and the 
behaviors of £ and uj are approximated by the solution of 
|(SJ. Linearizing (|TT)) at the origin, we obtain 



uj = A{1- cos(£)} 
n — m 

A = 



N 



(6) 
(7) 



The phase space of the (£,u>) system and the null cline 
are shown in Fig. EH where the origin corresponds to the 
one cluster state pL5| . 

Expanding equation © at the origin, we obtain 



lu = —auj ■ 



Ae + or) 



(8) 



The vector field at the origin has a zero and a negative 
eigenvalue, but when considering the second order we find 
that the origin, the one cluster state, is unstable. 

The stable solution of the two clusters state uJ = 
which is a limit cycle circling around the cylinder, is 
calculated as follows: When averaging cos(£) in ©, a 
limit cycle exists around the averaged line uj = ^, and 
duj/dt; ~ a <C lu indicates that the variation from the 
average is small (see Fig- EJ- Then, by substituting the 



5 = e 

e=-f sin(£)5-ae 



(13) 



Here, sin(£) can be treated as a forced oscillation term 
that is approximated as 

A a 2 [A 
£ ~ —t H — — cos — t 
a A \a 

»n(0 - -j+sm l-t U-cos (_*], (14) 



where £ = uj ~ — — asin(£) is integrated by using suc- 
cessive approximations. 

If a normal averaging method is applied, only the first 
constant term in (|14fl is taken to estimate the stability of 
(|13fl . However, the amplitude of the oscillation in second 
term is much larger than that of the first term (in the 
order of the square of a), and hence both terms should 
be included. Thus equations i|13fl can be expressed as 

'5 + aS+^(^+ S hx(^t)\s = 0. (15) 
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Setting 5 = R(t) exp{— %t}, we obtain the Mathieu equa- 
tion, 



R + (p- 2qsm(2t))R = 



_ a* I 2m 
^ "A^" \ AN 

„ _ 2a 2 m 



(16) 
(17) 



Here, p = 0(a 4 ) <C 1, q = 0(a 2 ) <C 1 is in the area 
of Mathieu's parameters where R = is stable. Since 
5 is the product of R and the exponential decay term 
exp{— ^t}, S is not destabilized by the 0(a 2 ) perturba- 
tion which is omitted to approximate sin(£). Therefore 
the clusters in the two clusters state can be concluded to 
be stable. 

In the present paper we introduce a novel type of cou- 
pled oscillator model where the time scales occur as vari- 
ables. It is shown that multiple clusters with different 
time scales emerge through a self-organization process 
based on time scale plasticity. This process is character- 
ized by symmetry breaking due to separation from the 
one-cluster state. 

Though we introduce our model Q as one of the sim- 
plest model to discuss time scale plasticity, which is also 
derived from a limit-cycle model with some assumptions, 
Suppose we have globally coupled limit cycles of normal 
form type in polar coordinates 



= 6(l-r?) + ^E^^--(? 1 ) 
= ar l (l-rf) + j r J2(cos(0 J -e i )r J 



(18) 



where the coordinate is chosen that the angular velocity 
becomes zero at the limit cycle. Then we assume b ^> 
a 3> D, transform r, = 1 — 0{D / a) = 1 — w% and omit 
the terms of 0(D/b) and 0(D 2 /a 2 ), 



9i = —2bwi 
Wi = —2aw; 



f E (1 - cos(0j - Oi)) 



(19) 



is obtained. Lastly with appropriate transformations, 
equation is derived. In this setup, the time scale 
of the each oscillator diverges at the limit cycle, and the 
plasticity results from the steep gradient of frequencies 
(b ^> D) around the cycle. In this way, such singular 
properties can also lead the plastic time scales . 

Another type of multiple frequency behavior in coupled 
oscillators is studied in the context of antenna and radar 
systems in [l2| where the hierarchy is characterized by a 
discrete symmetry group of the system. Although those 
hierarchies and the ones reported here have different 
mechanisms, a unified explanation should be developed 
for these structures. Since we use the simplest oscillator 
as the dynamical element, a hierarchy with only a few 
layers is observed. In more complex systems of chaotic 
oscillators, multiple layers can be self-organized (to be 
reported in a forthcoming paper [13 )• In this study, the 
initial conditions are restricted to the vicinity of the one- 
cluster state. When we choose more scattered out initial 
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FIG. 4: Time series data of uii from a highly spread ini- 
tial condition. Neither a large cluster nor large differences 
between Wi emerge and the whole system continues to be 
chaotic. 



conditions, coherent structures do not emerge, chaotic 
behaviors persist and large time scale differences are not 
generated (Fig. [3J . This implies the importance initial 
condition selection, a requirement common to many self- 
organization phenomena in highly complex systems |l4j . 
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